#inference costs

A New Google AI Research Proposes Deep-Thinking Ratio to Improve LLM Accuracy While Cutting Total Inference Costs by Half

A new Google AI research introduces the Deep-Thinking Ratio, a method to improve LLM accuracy while cutting inference costs by half. It challenges the traditional belief that longer reasoning chains lead to better outcomes.